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GUI CONTROL METHOD AND APPARATUS AND RECORDING MEDIUM 



[0001] 

FIELD OF THE INVENTION 
5 This invention relates to a graphical user interface GUI 

technique in an information processing apparatus. More 
particularly, it relates to a GUI control method, program and 
apparatus for improving the tractability and convenience in use 
of a software having the GUI and which is run on a computer 
10 typified by a personal computer (PC) or a workstation (WS) . 
[0002] 

BACKGROUND OF THE INVENTION 

In order to make a software, adapted for running on a 
computer, such as PC or WS, and having the GUI, convenient to 
15 use for a user, the applicable use of a software, that is what 
can be done using the software, and an operational sequence for 
the use, need to be definite for the user. 
[0003] 

In the case of an E-MAIL software, [reading a mail], 
20 [sending a mail] and [making an answer] are among the items of 
the applicable use of the software. It is also desirable that 
these items of use be readily understood by a user, that is that 
the user may readily comprehend that he or she is able to read 
or transmit a mall on the use of the software, and that, if once 
25 the applicable use is decided, it may readily be understood in 
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what sequence the software is to be operated in such use. 
[0004] 

This condition (demand) is particularly crucial for a 
beginner user with only poor experience in the computer. 
5 [0005] 

If the applicable use of the software is not definite, the 
user is unable to realize what can be done on the computer, so 
that the objective in using a computer (what one desires to do 
on the computer) cannot be achieved. Even if the app I icable use 
TO of the software are realized, the user is at a loss how to operate 
the computer, except if the operational seauence is definite, 
so that again the objective in using a computer cannot be 
ach i eved< 

[0006] 

15 Fig. 29 shows a typical conventional screenshot (picture 

screen) of a software with GUI adapted for running on a computer, 
such as PC or WS . In a typical conventional display of a software 
with GUI, as shown fn Fig. 29, the functions of the software are 
displayed/represented on a menu or as icons, and the user 

20 exploits this software by selecting the menu or icon. 
[0007] 

In the case of Fig. 29 T [FILE], [EDIT] and [VIEW] etc. belong 
to the menu items, with small rectangular widgets shown 
therebelow being icons. The numbers of these menu items and icons 
25 become larger, the larger, the number of the functions provided 
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in the software* 
[0008] 

SUMMARY OF THE DISCLOSURE 

In the typical conventional screenshot of a software with 
5 GUI, as described above, the functions provided in the software 
are displayed by menus or icons, however, the applicable use of 
the software is not clarified. For example, there are [creating 
a new document] or [opening and editing a document] among the 
items of applicable use of the software, a typical screenshot 
10 of which is shown in Fig. 29, however, the corresponding 
applicable use is not clarified on the screenshot shown in 
Fig. 29. 

[0009] 

On the other hand, current software products are mostly not 
15 provided with a mechanism for guiding (instructing) an 
operational sequence for exploiting the software in each 
app I i cab I e use. 
[0010] 

So, with a beginner user with only little experience in a 
20 computer, it is difficult to achieve the objective of using a 
software, that is, to realize what he or she wishes. 
[001 1] 

As methods for displaying the applicable use or guiding the 
operational seauence of the software, there may be envisaged 
25 (1) a method of endowing the software itself with a 
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mechanism displaying the applicable use or guiding the 
operational sequence of the software; and 

(2) a method of realizing a mechanism operated with the 
software for displaying the use or guiding the operational 
5 sequence of the software from outside the software without 
changing the program of the software. 
[0012] 

In the above method (1), the majority of the pre-existing 
software is not internally provided with such mechanism. If it 
10 is desired to provide a pre-existing software with display of 
the use and with the operational sequence guiding mechanism, it 
is necessary to change the software program. 

[0013] 

It is usually only the software supplier who can execute 
15 such change, while a third partyother than the software supplier 
is unable to change the software to realize the above-mentioned 
mechan i sm. 
[0014] 

In the case of the method (2K the mechanism such as 
20 indication of use or operational sequence guiding can be 

realized without changing the pre-existing software. However, 
there lacks such a method or mechanism which realizes such 
mechan i sm, 

[00153 

25 On the other hand, the number of menu items or icons on the 
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software window becomes larger, the larger the number of the 
functions provided on the software. As the functions provided 
on the software becomes diversified, and the number of GUI 
widgets such as menu items or icons, the operational sequence 
5 becomes complicated. In particular, in case of a beginner user 
with only poor experience in the computer, it is difficult to 
achieve the objective of using the software. 
[0016] 

For a beginner user, or a user who is in need of only a 
10 portion of the diversified functions, and who does not exploit 
other functions, the operational sequence would be clearer if 
a more simplified presentation is displayed, in which only the 
GUI widgets required are presented, without presenting the 
totality of the GUI widgets for the required functions. 
15 [0017] 

As a method for realizing a mechanism of displaying a 
simplified presentation (screenshot) in place of a presentation 
(screenshot) inherent to the software, there may be envisaged 

(1) a method of providing the software itself with a 

20 simplified presentation (screenshot) other than and in place of 
an inherent presentation (screenshot) of the software; and 

(2) a method of not changing the software program, but 
realizing a mechanism operated with the software for displaying 
the simplified presentation (screenshot) f or v i ew i ng by the user 

25 from outside the software, for notifying the operation for the 
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presentation (screenshot) as an operation to the inherent 
presentation (screenshot) of the software, while hiding the 
inherent presentation (screenshot) without presenting it to the 
user. 
5 [0018] 

However, with the method (1), the majority of the pre- 
existing software is not provided with the corresponding 
internal mechanism, so that, if desired to endow the software 
with such internal mechanism, the software program needs to be 
10 changed. Moreover, it is usually only the software supplier who 
can execute such change, while a third party other than the 
software supplier is unable to change the software to realize 
the above-mentioned mechanism. 

[0019] 

15 On the other hand, in the case of the method (2), the 

mechanism which allows the user to act on a screenshot different 
from the screenshot inherent to the software can be realized 
without changing the pre-existing software. However, there 
lacks such a method or apparatus which realizes such mechanism. 

20 [0020] 

As a technique relevant to the present invention, there is 
disclosed in e.g., the JP Patent Kokai JP-A-1 0-207676 such an 
arrangement in which, as a guide type application supporting 
system of learning the operating method of the application 

25 software and actual operating, unified together, the 
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operational sequence for the application software and the guide 
information are saved in a database, and which is made up of 
application conmun i ca t i on means for directly running the 
selected application software in accordance with the 
5 operational sequence saved in the database and, user 

presentation means for instructing the operating method for the 
application software directly operated by the application 
commun i ca t ion means by the image and the audio information in 
accordance with the guide information saved in the database. 
10 [0021] 

There is also disclosed in JP Patent Kokai JP-A-QB-01 9662 
a help display device for an information processing apparatus 
in which, in executing an application program, the operational 
flow diagram showing the operational sequence in a tree 

15 configuration from function to function is prepared and 

presented to the user, and inwhfch status transit! on indicating 
the status transition in the flow diagram for informing the user 
position by thick arrows and the route to the specified function 
may also be prepared and presented to the user. 

20 [0022] 

There is also disclosed in JP Patent Kokai J P-A-02-3009 1 3 
a software program operational sequence instructing device 
comprised of means for storing in memory means the operational 
sequence and the processing contents furnished by the software 

25 program, comparing the information on the operational sequence 
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fed to input means to the information on the operational sequence 
and the processing contents furnished by the software program 
and for verifying the point of difference between the two 
operational sequences and means for selecting and recommending 
5 the operational sequence information most analogous to the 
operational sequence stored in the memory means based on the 
checked result. 
[00231 

For example, in the JP Patent Kokai JP-A-1 1 -237978, there 
10 is disclosed a graphical user interface forming apparatus in 
which the co-re f erenc i ngbetween themenu it em and the GUI widget 
nay be comprehended at a glance- 
[0024] 

There is also disclosed in JP Patent Kokai JP-A-1 1-271 539 
15 a GUI picture forming system comprised of a display unit made 
up of a work area window for displaying a GUI picture, a widget 
list window for displaying pre-defined widgets, a widget list 
window for displaying combination widgets defined and 
registered by the picture purveyor and a tool window for 
20 displaying variable control tools, a GUI picture forming system 
having enclosed therein the combination widget registering 
process, and a file unit made up of the picture file, widgetfiie 
and the combination widget file. The picture provider is able 
to define in combination, register and re-use the widgets of the 
25 pre-defined minimum units to furnish a highly efficient tool. 
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[0025] 

Moreover, here is disclosed in e.g., the JP Patent Kokai 
JP-A-1 1-259200 a system and a method for setting user-definable 
command elements on a user interface in which, when a user 
5 desirous to execute a specified program task sets a visual 
command element on a user interface command necessary for 
executing the specified task, and selects a proper menu command 
in subsequently executing the same task, the user may be guided 
automatically from the visual command elements, such that, if 
10 the user selects a specified menu command, the visual command 
element can be automatical I y set in the total ity of the specified 
menu commands to be selected In achieving the specified menu 
command, in which the sequence to be selected in executing a 
specified task may be automatically set in the specified menu 
15 command having a visual command element, and in which the 
sequence to be selected for the specified menu command having 
the visual command element to execute a specified task is 
presented to the user. 

[0026] 

20 As a navigation tool for personal computer operation, there 

is now commer c ially available a software produced manufactured 
by SHARP CO. LTD, under the trade name of [PC navigator] 
{ h t tp : //sharp-wor I d. com/sc/exc i t e/sof t_map/cesQ2pn/) . With 
this [PC navigator], if a user queries what he or she desires 

25 to know in the natural language and clicks a relevant button, 
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a list of the response to the queried contents is displayed. If 
then the operation is selected and the relevant button clicked, 
the personal computer navigator automatically executes the 
operations. Moreover, since sample pictures or screenshots of 
5 the Word and Excel, both being the trademarks owned by Microsoft 
Corporation, and the Window (R) , similarly a registered 
trademark owned by Microsoft Corporation, are provided, to 
provide a sample input function, so that an operation the user 
desires can be found, 
10 [0027] 

However, the above-mentioned problem cannot be settled by 
these known techniques. 
[00283 

ft is therefore an object of the present invention to 
15 provide a GUI control method, apparatus and program which 

clarify the applicable use of an optional software to guide the 
operational sequence to enable an operation on a presentation 
(screenshot) different from the inherent screen without 
modifying the software provided with the GUI, so that even a 
20 beginner user will be able to exploit the software readily. 
[0029] 

For accomplishing the above object, the present inventors 
have completed an invention pertinent to a method, an apparatus 
and a program product as defined in the claims* 
25 According to a first aspect of the present invention, the 
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applicable use of the software is demonstrated in a menu form 
on a presentation (screenshot) of a display apparatus. If one 
use is selected on the menu, a GUI (graphical user interface) 
widget to be acted on next is demonstrated in a configuration 
5 outstanding from the surrounding background, in a pre-stored 
operational sequence. These operations are sequentially 
carried out to guide the operational sequence for realizing the 
above use. 
[0030] 

10 According to a second aspect of the present invention, a 

cover screen hiding an inherent screen of the software may be 
demonstrated on the display device, wherein the applicable use 
of the software is demonstrated in a menu form on the cover screen, 
If an operation is performed on the cover screen, an operation 
15 equivalent to that performed on the cover screen is then executed 
on the inherent screen of the software in accordance with a 
pr e-regi stered relationship with widgets. 
[0031] 

Moreover, the present invention includes 
20 (a) a step of previously registering in a storage unit the 

applicable use of a software adapted for running on a computer, 
the computer hav i ng a GUI; 

(b) a step of displaying the registered use as a menu item 
on a screen of a display device, inputting an operational 
25 sequence of the software, as required for utilizing the software 
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in the use, for registration in the storage unit, for each use 
d i sp I ayed on the menu ; and 

(c) a step of booting, on selection of the use from the menu, 
the software as required for the selected use, of detecting in 
5 what location in the screen a GUI widget to be acted on next, 
in accordance with the operating sequence previously registered 
for the selected use, and of displaying the detected GUI widget 
in a highlighted fashion on the screen or picture in accordance 
with the detected display location for the GUI; and 

10 (d) a step of detecting an operation of said GUI widget, 

in accordance with the previously registered operating sequence! 
of detecting in what position on the screen a GUI widget to be 
operated next, and of displaying the GUI widget in a highlighted 
fashion on the screen or picture, in accordance with the next 

15 detected display location of the next GUI widget. 
[0032] 

The GUI control apparatus includes: 
use menu display means for displaying t in a menu, the 
applicable use of a software adapted for running on a computer, 
20 the software having a graphical user interface GUI, 

use menu registration means for previously registering a 
use menu displayed by the use menu display means, 

use selection detection means for detecting, on selection 
of the use from the use menu displayed on the use menu display 
25 means, what use has been selected, 
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software booting means for booting the software required 
for the se I ect ed use, 

operational sequence registration means for previously 
registering the operational sequence for acting on the software 
5 i n the se I ec ted use, 

widget detection means for detecting in what location on 
the screen the GUI widget to be operated next is to be displayed 
on a screen, in accordance with an operating sequence registered 
for the selected use t 
10 operation target widget indicating means for displaying 

the GUI widget detected by the widget detection means in a 
highlighted fashion on a screen or picture, and 

operation detection means for detecting an operation made 
on a GUI widget detected by the widget detection means and for 
15 instructing the widget detection means to detect, in accordance 
with an operating sequence registered for the selected use, in 
what location an the screen the next GUI widget to be operated 
on next is displayed. 

Further aspects of the invention are disclosed in the 
20 entire claims which are incorporated herein by reference 
thereto. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows a configuration of a first embodiment of a GUI 
control device according to the present invention. 
25 Fig. 2 schematically shows a typical registration of a use 
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menu in the first embodiment of the present invention. 

Fig. 3 schematically shows a typical display screenshot of 
the use menu in the first embodiment of the present invention. 

Fig. 4 shows a typical screenshot (displayed picture 
5 screen] of the use menu in the first embodiment of the present 
i nven t i on. 

Figs, 5a and 5b show a typical screenshot (picture screen) 
of the software in the first embodiment of the present invention. 

Fig. 6 shows an illustrative operational sequence 
10 registered in operational sequence registration means 105 in the 
first embodiment of the present invention. 

Fig. 7 shows a typical display in which a widget designated 
by an operation target widget indicating unit 106 is shown 
highlighted in the first embodiment of the present invention. 
15 Fig. 8 shows a typicat display in which a widget by the 

operation target widget indicating unit 106 is shown high I ighted 
in the first embodiment of the present invention. 

Fig* 9 shows typical widget display by a widget display unit 
108 in the first embodiment of the present invention. 
20 Fig. 10 shows a configuration of a second embodiment of the 

present i nven t i on. 

Fig. 11 shows a typical screenshot (displayed picture 
screen) of the use menu in the second embodiment of the present 
i nven t i on. 

25 Fig. 12 shows a configuration of a third embodiment of the 
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present i nven t ion. 

Fig* 13 schematically shows a typical registration of the 
use menu in the third embodiment of the present invention, 

Fig. 14 shows a typical registration of the use menu in the 
5 third embodiment of the present invention. 

Fig, 15 shows a typical registration of the use menu in the 
third embodiment of the present invention. 

Fig, 16 shows a typical relation (correspondence) of 
widgets registered in the widget-relation information 
10 registration unit 1210. 

Fig. 17 shows a typical software screenshot (picture 
screen) in the third embodiment of the present invention. 

Fig, 18 shows a typical software screenshot in the third 
embodiment of the present invention. 
15 Fig. 19 shows a typical cover screen in the third embodiment 

of the present invention. 

Fig. 20 shows a typical relation of widgets registered in 
the widget-relation information registration unit 1210, 

Fig. 21 shows a typical relation of widgets registered in 
20 the widget-relation information registration unit 1 2 T 0 . 

Fig. 22 shows a typical cover screen in the third embodiment 
of the present invention. 

Fig. 23 shows a typical relation of widgets registered in 
the wi dget-rel at I on information registration unit 1210. 
25 Fig. 24 shows a typical relation of widgets-relation 
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information registered in the widget-relation information 
r eg i st rat ion un i t 1210. 

Fig. 25 shows a typical software screenshot in the third 
embodiment of the present invention. 
5 Fig. 26 shows a typical software screenshot in the third 

embodiment of the present invention. 

Fig. 27 shows a configuration showing a fourth embodiment 
of the present i nvent ion. 

Fig. 28 shows a configuration showing a fifth embodiment of 
1 0 the present i nvent i on. 

Fig. 29 shows a typical presentation (screenshot) of a 
software running on a control computer and which has a GUI. 

[0033] 

PREFERRED EMBODIMENTS OF THE I NVENT I ON 

15 An embodiment of the present invention is explained in 

detail by referring to the drawings. Referring to Fig. 1, a GUI 
control apparatus according to a preferred embodiment of the 
present invention includes use menu display unit 100 for 
displaying, in a menu, the applicable use of a software adapted 

20 for running on a computer and having a graphical user interface 
GUI, use menu registration unit 101 for previously registering 
a use menu displayed by the use menu display unit, use selection 
detection unit 102 for detecting, on selection of the use from 
the use menu displayed on the use menu display unit, which use 

25 has been selected, software booting unit 103 for booting the 
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software required for the selected use, operation sequence 
registration unit 105 for previously registering the 
operational sequence for acting on the software in the selected 
use, widget detection unit 104 for detecting in which location 
5 on thescreen the GUI widget tobeactedonnext is to be displayed 
on a screen or picture, in accordance with an operating sequence 
registered for the selected use T operation target widget 
indicating unit 106 for displaying the GUI widget detected by 
the widget detection unit in a highlighted fashion on a screen 

10 or picture, and operation detection unit 107 for detecting an 
action made on a GUI widget detected by the widget detection unit 
and for instructing the widget detection unit to detect, in 
accordance with an operating sequence registered for the 
selected use, in what location on the screen the GUI widget to 

15 be acted on next is displayed. 
[0034] 

Referring to Fig. 10, another preferred embodiment of the 
GUI control apparatus according to the present invention 
includes software booting detecting unit 1000 for detecting 

20 booting of a software adapted for running on a computer, the 
software having a graphical user Interface GUI, use menu d i sp I ay 
unit lOOfor displaying, in a menu, the applicable use of a booted 
software, use menu registration unit 101 for previously 
registering a use menu displayed by the use menu display unit, 

25 use selection detection unit 102 for detecting, on selection of 
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the use from the use menu displayed by the use menu display unit 
which use has been detected 105 operational sequence 
registration unit for previously registering an operational 
sequence for acting on the software in the selected use, widget 
5 detection unit 104 for detecting, in accordance with an 

operational sequence registered for the selected use, by the 
operational seauence registration unit, in which location on a 
screen the GUI widget to be acted on next is displayed, operation 
target widget indicating unit 106 for displaying the GUI widget 

10 detected by the widget detection unit 104 in a highlighted 
fashion on a screen or picture, and operation detection unit 107 
for detecting an action on a GUI widget detected by the widget 
detect ion unit and for instruct ing the widget detection unit 104 
to detect, in accordance with an operational sequence registered 

15 by the operational sequence registration unit, in what location 
on the screen the GUI widget to be acted on next is displayed. 
[0035] 

The present invention includes a unit 108 for displaying 
a GUI widget for notifying the completion of processing on a 
20 current screen, in which the operation detection unit 107 
detects an operation performed on the GUI widget detected by the 
widget detection unit 104 or on the GUI widget displayed by the 
w i dge t display unit 108. 
[00363 

25 Referring to Fig, 12, another preferred embodiment of the 
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GUI control apparatus according to the present invention 
includes a use menu displaying unit 12D3 for demonstrating on 
a menu the applicable use of a software operating on a computer, 
the software having a graphical user interface GUI, use menu 
5 registration unit 1 202 for previously registering the use menu 
demonstrated by the use menu displaying unit 1 2 03, use selection 
detection unit 1 204 for detecting the use selected from the use 
menu demonstrated by the use menu displaying unit1202 r software 
booting unit 1205 for booting a software necessary for the 

10 selected use, cover screen registration unit 1200 for previously 
registering, as a cover screen, a picture for employing the 
booted software in the selected use, cover screen display unit 
1201 for hiding an inherent screen of the booted software and 
for visibly demonstrating the cover screen registered by the 

15 cover screen registration unit in its stead, operation detection 
unit 1206 for detecting an operation on the GUI widget 
demonstrated on the cover screen to instruct the cover screen 
registration unft 1200 to display the cover screen, widget- 
relation (correspondence) information registration unit 1210 

20 for previously registering widget-relation information as to 
which GUI widget on the inherent screen of the software is to 
be acted on depending on any of the GUI widgets on the cover 
screen has been acted on, widget detection unit 1207 for 
detecting, depending on the widget-relation information 

25 registered by thewidget- relation information registration unit, 
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jn what location on the inherent screen of the software the GUI 
widget to be acted on next is demonstrated, and operation event 
issuing unit 1208 for issuing an operating event on the GUI 
widget detected by the widget detection unit 1207, It is 
5 previously registered by the widget-relation information 

registration unit 1210 any of the GUI widgets on the cover screen 
data displayed in any of the GUI widgets on the inherent screen 
of the software is to be copied. There is provided displayed 
data copying unit 1 209 for copying the data displayed in a GUI 
10 widget on the inherent screen of the software in the GUI widget 
on the cover screen in accordance with the widget-relation 
information registered by the widget-relation information 
regi s t rat ion unit 1210, 
[0037] 

15 Referring to Fig. 27, still another preferred embodiment of 

the GUI control apparatus according to the present invention 
includes use menu registration unit 1202 for previously 
registering the applicable use of a software, cover screen 
registration unit 1200 for previously registering a picture for 

20 using the software for the application as a cover screen, cover 
screen displaying unit 1201 for detecting the booting of the 
software, hiding an inherent screen of the booted software and 
for visibly demonstrating the cover screen registered by the 
cover screen registration unit in its stead, use menu displaying 

25 unit 1203 for demonstrating the applicable use of the booted 
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software as a menu on the cover screen demonstrated by the cover 
screen display unit, use selection detection unit 12Q4 for 
detecting, on selection of a use from the menu, which use has 
been se!ected T operation detection unit 1 Z 06 or detecting an 
5 operation on a GUI (graphical user interface) widget displayed 
on the cover screen, wf dget-re I at i on information registration 
unit 1210 for previously registering indicatingwhich GUI widget 
on an inherent screen on the software is to be actuated upon 
actuation of any of the GUI widgets on the cover screen, widget 

10 detection unit 1207 for detecting in what location on an inherent 
screen of the software the GUI widget to be acted on next is 
demonstrated in accordance with widget-relation information 
registered by the widget-relation information registration unit 
1210, and operating event issuing unit 1208 for issuing an 

15 operating event for a GUI widget detected by the widget detection 
unit 1207. It is previously registered by the widget-relation 
information registration unit 1210 in which GUI widget on the 
cover screen data displayed in which GUI widget on the inherent 
screen of the software is to be copied. There is provided 

20 displayed data copying unit 1209 for copying the data displayed 
in a GUI widget on the inherent screen of the software in the 
GUI widget on the cover screen in accordance with the 
widget-relation information registered by the widget-relation 
information registration unit 1210. 

25 [0038] 
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The functions and the processing of the above-mentioned 
respective unit are real ized by a program executed on a computer. 
That is, from a medium, such as a communication medium, carrying 
the program, the program is read into a computer via a preset 
5 interfacing unit and installed. The form of executing the 
program is loaded on a main memory of the computer and executed 
to carry out the present invention. 
[0039] 

The GUI control method according to the present invention 
10 preferably is comprised of the following respective steps: 
{0040] 

(a) a step of previously registering in a storage unit the 
applicable use of a software adapted for running on a computer, 
without changing the program of the software, the computer 

15 hav i ng a GU I , 
[0041] 

(b) a step of displaying the registered use as a menu on 
a screen of a display device, inputting an operational sequence 
of the software, as required for utilizing the software in the 

20 use, for registration in the storage unit, f or each use d i sp I ayed 
on the menu, 
[0042] 

(c) a step of booting, on selection of the use from the menu, 
the software as required for the selected use, detecting: by 

25 detection unit, in which location in the screen a GUI widget to 
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be acted on next, in accordance with the operating sequence 
previously registered for th selected use, and of displaying the 
detected GUI widget in a highlighted fashion on the screen or 
picture in accordance with the detected display location for the 
5 GUI* and 

[0043] 

(d) a step of detecting an action of the GUI widget, 
instructing the detection unit, in accordance with the 
previously registered operating sequence, to detect in which 
10 position on the screen a GUI widget to be acted on next and 
displaying the GUI widget in a highlighted fashion on the screen 
or picture, in accordance with the detected display location of 
the GU I widget. 

[00443 

15 A GUf control method in another embodiment of the present 

invention incl udes 
[0045] 

(a) a step of previously registering in a storage unit the 
applicable use of a software adapted for running on a computer, 

20 the computer having a GUI, 
[0046] 

(b) a step of detecting, on booting the software, such 
booting of the software, and displaying the applicable use of 
the software on a screen of a display device, 

25 [0047] 
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(c) a step of registering in the storage unit the operating 
sequence of the software for utilizing the software in the use, 
for each of the use displayed on the menu, 

[0048] 

5 (d) detecting, on selection of the use from the menu, in 

what location in the screen a GUI widget to be acted on next is 
displayed, in accordance with the operating sequence previously 
registered for th selected use, by detection unit, and of 
displaying the detected GUI widget in a highlighted fashion on 
10 the screen or picture in accordance with the detected display 
I ocat ion for the GUI, 
[0049] 

(e) detecting an action on the GUI widget, and 
[0050] 

15 (f) instructing the detection unit, in accordance wi th the 

previously registered operating sequence, to detect in which 
position on the screen a GUI widget to be acted on next and 
displaying the GUI widget in a highlighted fashion on the screen 
or picture, in accordance with the detected display location of 

20 the GUI widget. 
[0051] 

A GUI control method in still another embodiment of the 
present invention preferably is comprised of the following 
respective steps: 
25 [0052] 
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(a) a step of previously registering in a storage unit the 
applicable use of a software adapted for running on a computer, 
the computer having a GUI, 

[0053] 

5 (b) a step of displaying the registered use in a menu on 

a screen of the display device and booting, on selection of the 
use from the menu, the software as required for the selected use, 
[0054] 

(c) a step of previously registering in a storage unit a 
10 screenshot for utilizing thebooted software in the selected use, 

as a cover screen, 
[0055] 

(d) a step of hiding an inherent screen of the software 
booted from view and visibly displaying the registered cover 

15 screen, 

[0056] 

• te) a step of detecting an action on a GUI widget displayed 
on said cover screen to display the next cover screen, 
[0057] 

20 (f) a step of previously registering in the storage unit 

widget-relation information as to which GUI widget on the 
inherent screen of the software is to be acted on acting on any 
of the GUI widgets on the cover screen, 
C0O583 

25 (g) a step of detecting, in accordance with the registered 
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widget-relation information, in which location on the inherent 
screen of the software the GUI widget to be acted on next is being 
d i sp I ayed, 
[0059] 

5 (h) a step of issuing an operating event to the detected 

GUI widget, 
[0060] 

(i) a step of previously registering widget-relation 
information as to in which GUI widget on the cover screen the 
10 data displayed on a GUI widget on the inherent screen of the 
software is to be copied and 

[0061] 

(j) copying the data displayed on the GUI widget on the 
inherent screen of the software in the GUI widget on the cover 
15 screen in accordance with the registered w i dge We I at i on 
i n forma t i on. 

[0062] 

A GUI control method in still another embodiment of the 
present invention preferably is comprised of the following 
20 respect ive steps : 
[0063] 

(a) a step of previously registering in a storage unit the 
applicable use of a software adapted for running on a computer, 
the computer having a GUI, 
25 [0064] 
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(b) a step of previously registering a screenshot for 
utilizing the software in the use as a cover screen in the storage 
un i t, 

[0065] 

5 (c) a step of detecting, on booting the software, such 

boating, hiding an inherent screen of the software booted from 
view, visibly displaying the registered cover screen in its 
stead and displaying the applicable use of the booted software 
in a menu on a cover screen in a menu, 
10 [0066] 

(d) a step of displaying, on selection of use from the menui 
the cover screen registered for the selected use, 

[0067] 

(e) a step of detecting an action on a GUI widget displayed 
IS on the cover screen to display the next cover screen, 

[00681 

(f) a step of previously registering in the storage unit 
the widget-relation information as to which GUI widget on the 
inherent screen of the software is to be actuated on actuation 

20 of which GUI widget on the cover screen, 
[0069] 

(g) a step of detecting in which location on the inherent 
screen of the software the GUI widget to be acted on next is to 
be displayed in accordance with the registered widget-relation 

25 information, 
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[0070] 

(h) a step of issuing an operating event on the detected 
GUI widget. 
[0071] 

5 (i) previously registering in the storage unit widget- 

relation information as to in which GUI widget on the cover 
screen data displayed on the GUI widget on the inherent screen 
of the software is to be copied, and 
[0072] 

10 (J) a step of copying data displayed in the GUI widget on 

the inherent screen of the software in the GUI widget on the cover 
screen in accordance with the registered widget-relation 
i nf orma t i on. 
[Q073] 

15 [Preferred Embodiments] 

For further detailed description of the above-described 
embodiments of the present invention, certain preferred 
embodiments of the present invention are explained by referring 
to the drawings. 

20 10074] 

Fig. 1 shows a configuration of a first embodiment of a GUI 
control apparatus according to the present invention. Referring 
to Fig. 1, the first embodiment of the present invention includes 
use menu display unit 100, use menu registration unit 101, use 

25 selection detection unit 102, software booting unit 103, widget 
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detection unit 104, operational sequence registration unit 105, 
operation target widget indicating unit 106- operation 
detection unit 10T and widget display unit 108. The processing 
and functions of these units are realized by a program (product) 
5 executed on a computer. Meanwhile, display unit, input unit, 
such as keyboard or pointing device, routinely provided on a 
computer executing the program, are not shown in Fig. 1. The 
computer configuration is explained later with reference to 
Fig. 27. 
10 [0075] 

On completion of booting of the computer, the use menu 
display unit 100 demons t rates the use menu on the computer screen 
after booting. 
[0076] 

15 The "use menu" is a menu showing the applicable use(s) of 

the computer (what can be done on the computer) and is registered 
at the outset by the use menu registration unit 101. 
[0077] 

Fig. 2 schematically shows typical registration on the use 
20 menu. In the embodiment shown in Fig. 2, the use menu display 
unit 100 on completion of computer booting demonstrates a menu 
20 on the screen of the booted computer. 
[0078] 

Fig. 3 shows the state of display on a computer screen. In 
25 the embodiment of Fig. 3, a screenshot (p i cture screen) frame 30 
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shows the entire screenshot, with the menu 20 being demonstrated 
centrally of the screenshot. 
[0079] 

If a user clicks and selects e.g., a "mail" as a generic 
5 category of use on the screenshot of Fig. 3, the use selection 
detection unit 102 detects this selecting operation. Since it 
is noticed from Fig. 2 that the menu displayed next is a menu 21, 
the use menu display unit 100 demonstrates the menu 21 on the 
screenshot. Fig. 4 shows this state. 
10 E0080] 

If the user clicks and selects the "read a mail" in the 
screenshot of Fig. 4, the use selection detection unit 102 
detects this selecting operation. The software booting unit 103 
references the information registered in the software booting 
15 information 1, with the software booting unit 103 referencing 
the information registered in the software booting information 
1 of Fig. 2 to boot the software. 
[0081] 

Referring to Fig. 2, parameters for booting the software 
20 necessary for "reading the mail" are registered in the software 
booting information 1. The software booting unit 103 boots the 
software in accordance with these parameters. Fig. 5a shows a 
typical screenshot immediately following the software booting. 
[0082] 

25 In the operational sequence registration unit 105, there 



.20011 1H12B 18M fiWiffil 

t 

31 



NO. 6284 P. 32 



is registered at the outset an operating sequence for use of each 
of the i terns (i. e. , operational subclass steps under the generic 
category of use "Mail") of the menu 21 of Fig. 2, such as "reading 
a mail 11 or "sending a mail" of the menu 21 of Fig. 2, or "viewing 
5 a home page T ' or "searching a home page " of the menu 22. By way 
of an example, the operating sequence for the item "reading a 
mail" of the menu 21 of Fig. 2 is registered as shown for ex ant p I e 
in Fig. 6. 
[00331 

10 An embodiment shown in Fig. 6 shows that the operating 

sequence for "reading a mail" is as follows: 
[0084] 

(1) First, a widget having a widget label of 
"communication" and the class name of "Menu bar" lying on a 

15 window having a title of the "E-MAIL" and a class name of 
" Ema i IMainWirT is cl i eked. 

(2) Next, a widget having a label "receiving a mail' 1 and 
a class name "Menu" lying on a window having a title of the 
"E-MAIL" and a class name of "Ema i I Ma i n W i n " is clicked. 

20 (3) Finally, a wfdget having a label "OK" and a class name 

"Button" lying on a wi ndow having a title "receiving a mail" and 
a class name of "Ema M Ma i nW i n " is clicked. 
[0085] 

In accordance with the operational sequence registered by 
25 the operational sequence registration unit 105, the widget 
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detection unit 104 detects in what position on the screen the 
widget to be operated next is demonstrated. 
[0086] 

It is assumed that, as an example, the user has selected 
5 "reading a mail" on the screenshot shown in Fig. 4 and that the 
operating sequence registered for this menu item is that shown 
in F i g. 6. 
[0087] 

In this case, since the widget to be acted on first is a 
10 widget having a label of "communication" and the class name of 
"Menubar" lying on a window having a title of the "E-MAIL" and 
a class name of "Ema i I Mai nWi n'\ it is detected in what position 
on the screen a widget that meets this condition is displayed. 

[0088] 

15 If, in the embodiment shown in Fig. 5a, the widget is the 

"communication" menu in Fig. 5a, the widget detection unit 104 
detects a coordinate value (x1, yl) at an upper left (end) point 
of the "communication" and a coordinate value (x2, y2) at a lower 
r i ght (end) po i nt of the "commun i cation" menu as shown in Fig. 5 b. 

20 [0089] 

The operation target widget indicating unit 106 displays 
thewidget detected by thewidget detection unit 104 in a readily 
noticeable manner so that the user can recognize it instantly. 
This state is shown in Figs, 7 and 8. 

25 [0090] 
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In the embodiments shown in Figs. 7 and 8, the widget being 
acted on is highlighted by encircling it with a frame and by 
indicating it with an ar row, respectively. S i nee t he w i dge t to 
he acted on next is highlighted, the user may realize readily 
5 which widget is to be acted on next. However, any other su i tab I e 
technique for highlighting the widget on the screenshot, such 
as changing an emphasizing the display color or inverting the 
displayed letters in luminosity may be used. 
[0091] 

10 If the user acts on a widget, highlighted by the operation 

target widget indicating unit 106, the operation detection unit 
107 detects the operation. 
[0092] 

If the operation detection unit 107 detects the operation, 
15 the widget detection unit 104 detects the display position of 
the widget to be acted on next, with theoperation target widget 
indicating unit 106 then highlighting the objective widget. 

[0093] 

The above-described operating sequence is repeated until 
20 the entire operating seauence registered in the operational 
seauence registration unit 105 is finished. 
E0094] 

The operation of the widget display unit 108 is as follows: 
If the widget acted on is a menu or a button, the operation 
25 thereon will be finished just on clicking. However, if the 
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widget acted on is a text field, it is unknown at the outset how 
many letters are being input by the user, So, if the widget to 
be acted on is the text field, such a widget which clarifies 
(identifies) completion of inputting is demonstrated on the 
5 screenshot 
[0095] 

Fig. 9 shows a typical widget demonstrated by the widget 
display unit 108. In the embodiment shown in Fig. 9, a letter 
queue is input to a text field [To:] encircled by a frame. If 
10 then a widget 90 is clicked, the operation detection unit 107 
detects the clicking, followed by instructing the widget 
detection unit 104 to detect the next widget. 
[00961 

Meanwhile, in case where thewidget to be acted on is a text 
15 field, not "operation event = [click]" but "operation event - 
[letter input!" is registered. If the widget registered 
"operation event = [letter input!" is a widget acted on, the 
widget display unit 108 demonstrates a widget like the widget 
90 of Fig. 9 on the screenshot. The display position of the 
20 widget 90 is determined on the basis of the display coordinate 
values of the widget detected by the widget detection unit 104. 
[0097] 

Meanwhile, the screenshot configuration shown in Figs. 2 to 
9 are intended for illustrating the invent ion. It is to be noted 
25 that the present invention is not limited to the above-described 
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screenshot configuration. 
[0098] 

[Embodiment 2] 

The second embodiment of the present invention is now 
5 explained. In the above-described first embodiment, the 

software is booted by the software booting unit 103 based on the 
software booting information registered at theoutset in the use 
selection detection unit 102. 
[0099] 

10 in the second embodiment of the present invention, the user 

pushes a software booting key on a keyboard to boot the software. 
[0100] 

Fig. 10 shows the configuration of the second embodiment of 
the present invention. Referring to Fig. 10, if the software 
15 booting key on the keyboard is pushed to boot the software, a 
software booting detection unit 1000 detects the booting of the 
software to instruct the use menu display unit 100 to demonstrate 
the use menu for the software. 

[01013 

20 It is assumed, as an example, that a [MAIL] key on the 

keyboard is pushed in a state shown in Fig. 3. In this case, the 
software booting detection unit 1000 detects the booting of the 
E-MAIL software, based on the pushing of the [MAIL] key, so that 
the use menu display unit 100 demonstrates the use menu for the 

25 detected software on the screenshot. The result is that the 
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screenshot (screen display) is as shown for example in Fig. 11. 
[0102] 

in the embodiment shown in Fig. 11, the window of the 
software booted on pushing the [MAIL] key on the keyboard, whilst 
5 the use menu demonstrated by the use menu display unit 100 is 
a menu 21 of Fig. 2. 

[0103] 

As may be seen from the above-described first embodiment, 
it is possible to clarify the use of the software and the 
10 operational sequence for the use without changing the program 
of the software having the GUI. Thus it is possible for a 
beginner with only poor experience in the use of the computer 
to exp lo i t the software. 

[0104] 

15 The second embodiment of the present invention now 

explained is similar to the above-described first embodiment. 

If, for example, [read i ng a ma i I] is selected on the screenshot 
of Fig. 11, the use selection detection unit 102 detects the 
selection sequence, with the widget detection unit 104 then 

20 detecting, in accordance with the operational sequence 

registered by the operational sequence registration unit 105, 
in which position on the screen the widget to be acted on next 
is displayed. The operation target widget indicating unit 106 
then highlights the widget detected by the widget detection unit 

25 104 on the screenshot. The result is that the screenshot is as 



•200 1$ 1A12B 18s|53ft liWIilM 

37 



NO, 6234 P. 38 



shown in Fig. 7 or 8. 
[0105] 

As may be seen from the above-described second embodiment, 
it is possible to clarify the use of the software and the 
5 operational sequence for the use without changing the program 
of the software having the GUI. Thus it is possible for a 
beginner with only poor experience in the use of the computer 
to exp I o i t the sof tware. 
[0106] 

10 [Embodiment 3] 

A third embodiment of the present invention is now 
explained. F i g. 1 2 shows the configuration of the third 
embodiment of the present invention. Referring to Fig. 12, a 
cover screen display unit 1201 demonstrates a coyer screen on 
15 the as-booted computer screen. 
[0107] 

The [cover SCREEN] is a display window screenshot 
demonstrated on the uppermost surface of a multi-window to the 
same size as the background picture size (e.g.. screen size). 
20 By d i sp I ay i ng the wi ndow of the cover screen (screenshot) to the 
same size as the background picture, the basic picture 
(screenshot) of the as-booted computer is hidden by the window 
of the cover screen from the sight of the user. 
[0108] 

25 The cover screen demonstrated by the cover screen display 
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unit 1201 is registered at the outset by cover screen 
regis t rat i on unit 1 200. 
[0109] 

If the cover screen display unit 1201 demonstrates the 
5 window of the cover screen, use menu display unit 1202 

demonstrates the use menu on the window of the cover screen. 
Similarly to the above-described first embodiment, the use menu 
represents the use of the computer (what can be done by using 
the computer), as in the above-described first embodiment, and 
10 is registered at the outset by the use menu registration unit 
1 202. 

[0110] 

Fig. 13 schematically shows typical registration on the use 
menu. In the embodiment shown in Fig. 13, if the cover screen 
15 display unit 1201 demonstrates the window of the cover screen, 
a menu 1300 is displayed on the window, as shown as an example 
in Fig. 14. 
[01 11] 

If, in the screenshot shown in Fig. 14, the user clicks and 
20 selects [MAIL], the use selection detection unit 1204 detects 
the selecting operation. Then, software booting unit 1205 
references the information registered in the software boating 
information 1 of Fig. 13 to boot the software. In the software 
booting information 1 of Fig. 13, there are registered booting 
25 parameters for the E-MAIL software, such that the software 
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booting unit 1205 boots the software using these parameters. 
[0113] 

On booting the software, its window is displayed on the 
screen. However, since the window of the cover screen with the 
5 same size as the screenshot is displayed on the uppermost layer 
of the multi-window, the screen of the as-booted computer is 
hidden by the window of the cover screen from the sight of the 
user. 

[0114] 

10 If, i n the sc reenshot of F i g. 14, the user clicks and select 

[MAIL], as an example, since the menu to be displayed next is 
a menu 1301 (Fig. 13), user menu display unit 1 203 demonstrates 
the menu 1301 on the screen in paral lei with the software booting 
by software booting unit 1205. Fig, 15 shows a typical such 

15 state and displays the demonstrating screenshot for the use 
menu. 

[0115] 

In widget-relation registration unit 1210, it is pre- 
registered which widget of the software booted by the software 
20 booting unit 1 205 is to be acted on when a given widget on the 
cover screen is acted on. 

[0116] 

Fig. 16 shows a typical case of registration (instance of 
the relation with registered widgets). It is registered in the 
25 embodiment shown in Fig. 16, a widget [reading a mail] is acted 
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on in the cover screen window, it suffices to execute the 
following three operations in succession for the software booted 
by the software booting unit 1205: 
[0117] 

5 (1) First, a widget with a label "communication"andaclass 

name "Menubar", lying on a window with a class 
name"Emai IMainWin" and a title "E-MAIL" is clicked; 

(2) Second, a widget with a label "Receiving a Mail" and 
a class name "Menu", lying on a window with a class 

10 name "Ema i IMainWin" and a title "E-MAIL" is clicked; and 

(3) Third, a widget with a label "OK" and a class name 
"Button", lying on a window with a class name "Emai IMainWin" and 
a title "Receiving a Mail" is clicked. 

[0118] 

15 If, in the screenshot shown in Fig. 15, the user cl icks and 

selects [reading a mail], the use selection detection unit 1204 
detects the selecting operation, and widget detection unit 1207 
then detects the display position of a widget with an operating 
number = 1 registered in the widget-relation registration unit 

20 1210. 

[0119] 

If the wind ow of the software booted by the software booting 
unit 1205 is the window of Fig. 17, the widget with the operating 
number = 1 in Fig. 16 is the [communication] menu on the window 
25 of Fig. 17, so that the widget detection unit 1 207 detects the 
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display position with the operating numb$r = 1 of the 
widget-relation registration table (Fig. 16) registered in the 
widget-re i at ion registration unit 1210. 
[0120] 

5 Since the window of F i g. 1 7 is displayed on a lower level 

surface of the cover screen window, the window of Fig. 17 is not 
visible to the user. 
[01213 

When the widget detection unit 1207 detects the display 
10 position of the [communication] menu of Fig. 17, operation event 
issuing unit 1208 issues an operating event of selecting the 
[commun i ca t i on] menu, 
[0122] 

On the screenshot t the cover screen window is demonstrated 
15 on the uppermost level surface of the cover screen window, with 
the w i ndow of Fig. T7 being on its lower level surface, the event 
issued by the operation event issuing unit 1 208 is notified not 
to the cover screen window hut to the hidden window of F i g. 1 7 
lying on its lower level surface. 
20 [0123] 

The widget detection unit 1207 then detects the display 
position of the widget with the operating number = 2 of Fig, 16, 
with the widget detection unit 1 207 then issuing an operating 
event for the detected widget, as before. 
25 [0124] 
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The widget detection unit 1207 then detects the display 
position of the widget with the operating number = 3 of Fig. 16, 
with the widget detection unit 1207 then issuing an operating 
event for the detected widget. 
5 [0125] 

As a result, the software window booted by the software 
booting unit 1 205 is as shown in Fig. 18. 
[0126] 

At a time point the use selection detection unit 1204 has 
10 detected the user operation of selecting [reading a mail] on the 
screenshot shown in Fig, 15, the cover screen display unit 1201 
demonstrates a screenshot pre-regi stered by the cover screen 
registration unit 1 200. This state is shown in Fig. 19. 
[0127] 

15 After the operation event issuing unit 1208 has issued an 

operating event for the widget with the operating number = 3 of 
Fig. 16. displayed data copying unit 1209 copies data 
demonstrated on the widget of the software window booted by the 
software boot i ng un i t 1 205 on a widget on the window of the cover 

20 screen demonstrated on the cover screen display unit 1201. 
[0128] 

In the widget-relation registration unit 1210, it is 
pre-registered which data displayed on which widget is to be 
copied on which data. Figs. 20 and 21 show these registration 
25 instances. 
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[0129] 

In the case of Fig. 20, it is indicated that data displayed 
on a widget (assumed to be a widget 1 800 of Fig. 18) with the label 
[From:] and the class name of [Edit] lying on the window with 
5 the title [MAIL DISPLAY] and with the class name [Emai IViewWin] 
is tobe coo i ed on awidget (assumed to be awidget 1 900 of Fig. 19) 
with the ID (identification information) of [FromField] lying 
on the cover screen window. 
[0130] 

10 Likewise, in the case of Fig. 21, it is indicated that data 

displayed on a widget (assumed to be a widget 1801 of Fig. 18) 
with the label [MESSAGE : ] and the class name of [Edit] lying on 
the wind ow with the title [MAIL D I SPLAY] and with the class name 
[Em a i IViewWin] i s to be cop i ed on a w i dge t (assumed to be a wi dget 

15 1901 of Fig. 19) with the ID of [BodyField] lying on the cover 
screen window. 
[0131] 

In this case* the displayed data copying unit 1 203 copies 
the data displayed on the widgets 1800 and 1801 shown in Figs. 18, 
20 19, respectively, on the widgets 1 900 and 1901 shown in Fig. 19. 
[0132] 

As a result, the cover screen is as shown in Fig. 22, in which 
it is shown that three buttons, namely [READ PREVIOUS MAIL], 
[READ NEXT MAIL] and [RETURN TO MENU] are provided on the cover 
25 screen window. 
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[0133] 

It is assumed that correspondence of the widgets to the 
buttons [READ NEXT MAIL] and [RETURN TO MENU] is registered by 
the widget-relation registration unit 1210 as shown in Figs. 23 
5 and 24. 

[0134] 

In the case of Fig. 23, it is registered that, if the button 
[READ NEXT MAIL] is selected in the screenshot of Fig. 22, it 
suffices ff the following two operations; 
tO (1) operation of clicking a widget with a label [MAIL] and 

a class name [Menubar] lying on the window with the class name 
of [Emai I ma inWi n] and with the title [E-MAIL], and 

(2) operation of clicking a widget with a label [DISPLAY 
NEXT MAIL] and a class name [Menu! lying on the window with the 
15 class name of [Ema M ma i nW i n] and with the title [E-MAIL] 

are sequentially executed on the software booted by the 
software booting unit 1205. 

[0136J 

Similarly, in the case of Fig.24, it is registered that, 
20 if the button [return to menu] is selected in the screenshot of 
Fig. 22, it suffices if the following operation: 
[0137] 

(1) the operation of clicking a widget with a label [CLOSE] 
and a class name [Button] lying on the window with the class name 
25 of [Emai IVi ewWin] ahd with the title [DISPLAY MAIL] 
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is executed on the software booted by the software booting 
unit 1205. 
[0138] 

If, in the screenshot of Fig. 22, the user clicks and selects 
5 the button [READ NEXT MAIL], operation detection unit 1206 
detects the operation, with the widget detection unit 1207 
detecting the display position of a widget with the operating 
number = 1 of the widget-relation registration table of Fig. 23 
registered by the widget-relation registration unit 1210. 

10 [0139] 

It is assumed that the window of the software, booted by 
the software booting unit 1 205, is as shown in Fig. 18, with the 
widget with the operating number = 1 being the [MAIL] menu on 
the [E-MAIL] window of Fig. 18. In this case, the widget 

15 detection unit 1207 detects the (x, y) coordinate value on the 
left upper (end) point and the (x, y) coordinate value on the 
right lower (end) point of the [MAIL] menu. However, since the 
[E-MAIL] window and the [MAIL DISPLAY] window of Fig. 18 are 
displayed on a lower level surface of the cover screen, the two 

20 windows of Fig. 18 are not visible to the user. 
[0140] 

If the widget detection unit 1207 detects the display 
position of the [MAIL] menu of Fig. 18, the operation event 
issuing unit 1208 issues an operating event for the detected 
25 widget, as before. 
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[0141] 

The widget detection unit 1207 then detects the display 
position of the widget with the operating number = 2 of Fig. 23, 
with the widget detection unit 1207 then issuing an operating 
5 event for the detected widget. 
t0 1 423 

As a result, the software window booted by the software 
booting unit 1205 is as shown in Fig. 25, 
[0143] 

= 10 The displayed data copying unit 1209 copies the data 

demonstrated on the widgets 1800, 1801 of Fig. 25 on the widgets 
1 900, 1 901 of F i g. 22, as i n the above-descr i bed embod i men t. As 

: a result, the cover screen windows as shown in Fig. 26, 

[0144] 

I 15 If then the user clicks the button termed [RETURN TO MENU] 

y in the screenshot of Fig. 26, the operation detection unit 1206 

I detects this operation tonotifyto the cover screen dlsplayunit 

1201 that the menu screenshot of Fig. 14 be displayed. 
[0145] 

20 The widget detection unit 1207 detects the display position 

of the widget with the operating number - 1 in the widget- 
relation registration data of Fig. 24 registered by the 
widget-relation registration unit 1210. 
[0146] 

25 If thewindowof the software booted by the software booting 
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unit 1 205 is as shown in Fig. 25, and the widget with the operating 
number = 1 of Fig. 24 is a button [CLOSE] on the window [DISPLAY 
MAIL] of Fig. 25, the widget detection unit 1 207 detects a (x, y) 
coordinate value at the left upper (end) point and a (x, y) 
5 coordinate value at the right lower (end) point of the button 
[CLOSE] . 

[01471 

If the widget detection unit 1207 detects a display 
position of the button [CLOSE] of Fig. 25, the operation event 
10 issuing unit 1208 issues an operational event Df selecting the 
detected [CLOSE] button, as before. 
[0148] 

The result is that the window of the software booted by the 
software booting unit 1 205 returns to the state shown in Fig. 17. 
15 [0149] 

In the third embodiment of the present invention, as may 
be seen from the above-described first embodiment, it is 
possible to clarify the applicable use of the software having 
the GUI andtoclarifytheooeratingsequencefor thisapplicable 
20 use, without changing the program of the software. So, even a 
beginner with only little experience in using the computer may 
use the software. 
[0150] 

A fourth embodiment of the present invention is hereinafter 
25 explained. In the above-described third embodiment, the 
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software booting unit 1205 boots the software, based on the 
software booting information registered in the use menu display 
unit 1202. In the present fourth embodiment, a user pushes a 
software booting key on the keyboard to boot the software. 
5 Fig. 27 shows the configuration of the fourth embodiment of the 
present invention. 
[0151] 

Referring to Fig. 27, if a software booting key on a keyboard 
is pressed to boot the software, the software booting detection 
1Q unit 1 000 detects the booting of the software to notify the user 
menu display unit 1203 that the use menu for the software be 
displayed. 
[0152] 

Assume that the screenshot is in a state shown in Fig. 14, 
15 and a [MAIL] key on the keyboard has been pushed. In this case, 
the software booting detection unit 1000 detects that the 
software of the E-MAIL program has been booted by the pressing 
of the [MAIL] key, with the user menu display unit 1203 then 
causing the use menu for the detected software to be displayed 
20 on a widow of the cover screen. 
[0153] 

The result is that the displayed screenshot is as shown in 
Fig. 15. The following operation is the same as that in the 
above-described third embodiment. That is, in the fourth 
25 embodiment, the window of the software booted on pressing the 
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software boot key on the keyboard is displayed as a lower surface 
on the cover screen and hence is not visible from the user. 
[01541 

In the fourth embodiment of the present invention, it is 
5 again possible to clarify the applicable use of the software 
having the GUI and to clarify the operating sequence for this 
applicable use, without changing the program of the software. 
So, even a beginner with only little experience in using the 
computer may use the software. 
10 [01551 

[Fifth Embodiment] 

A fifth embodiment of the present invention is now 
explained. Fig. 28 shows the configuration of the fifth 
embodiment of the present invention. The present fifth 

15 embodiment of the present invention realizes the GUI control 
device of the above-described first to fourth embodiments by the 
executable program (GUI control program) runn i ng on a compu t er, 
as exemplified by PC or WS. Fig. 28 shows an illustrative 
structure of a computer. The executable program (contemplated 

20 as a program product) is recorded on a recording medium 2801 
exemplified by a hard disc, a floppy disc, a CD-ROM, an MT 
(magnetic tape) or a DVD (digital versatile disc), and is read 
out to the computer 2800 for execution to cause the computer 2800 
to operate a GUI control device explained in the above-described 

25 first to fourth embodiments. Output unit for outputting the 
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operational result is a display 2804. Also, data registered in 
the use selection unit or in the operational sequence 
registration unit are recorded on a recording device provided 
on the computer, such as a RAM (random access memory] or on a 
5 recording medium such as a hard disc, or on the recording medium 
2801, if the recording medium 2801 is recordable, so as to be 
read out to the computer 2801 for processing by the executable 
program, Note, however, the program may be supplied through 
Internet or other source in a running or dynamic state carried 
10 on a carrier wave. 
[0155] 

The meritorious effects of the present invention 
are summar i zed as foil ows, 

As described above, the following meritorious effects are 
t5 achieved with the use of the GUI control method or apparatus 
according to the present invention: 
[0157] 

The first meritorious effect of the present invention is 
that the software can be utilized even by a beginner with only 

20 poor experience in the use of the computer. The reason is that, 
according to the present invention, it is possible to clarify 
the applicable use of the soft ware having the GUI and to clarify 
the operating sequence for this appl icable use, without changing 
the program of the software. 

25 [0158] 
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The second meritorious effect of the present invention is 
that the software can be utilized even by a beginner with only 
poor experience in the use of the computer. The reason is that, 
according to the present invention, it is possible to clarify 
5 the applicable use of the software having the GUI and to display 
a more simplified screenshot in which only GUI widgets for the 
necessary functions are displayed. 

It should be noted that other objects, features and aspects 
of the present invention will become apparent in the entire 
10 disclosure and that modifications may be done without departing 
the gist and scope of the present invention as disclosed herein 
and claimed as appended herewith. 

Also it should be noted that any combination of the 
disclosed and/or claimed elements, matters and/or i terns may fall 
15 under the modifications aforementioned. 



